

METHOD AND APPARATUS FOR FOSTERING 
IMMERSIVE READING OF ELECTRONIC DOCUMENTS 



Technical Field 



The invention relates generally to methods and apparatus for displaying 
electronic documents. More particularly, the invention relates to methods and 
apparatus for presenting electronic documents in a manner that fosters an immersive 
reading experience like that provided by a printed paper document, while providing 
enhanced functionality beyond the functionality provided by a printed paper 
document. 



As computers have become smaller and more powerful, there have been recent 
efforts to provide portable, hand-held computers for rendering electronic content in a 
manner that is similar or identical to the way content is presented in a printed paper 
book or other document. Thus, much effort has focused on providing a user interface 
for computers that fosters an immersive reading experience, or the sensation of being 
"lost" in the electronic document. 

One primary advantage that computers offer over printed paper documents as a 
means for presenting documents to users is that computers can make added 
functionality available to the user. Such functionality may include navigational 
functions that permit the user to navigate to and thus view other pages of the 
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document, or view other documents, instantly and without considerable interruption in 
the user's reading experience. Such functionality may also include interaction with 
content, such as highlighting, annotating or looking up word definitions or synonyms 
in dictionaries or thesauruses. 

Yet providing a user access to the enhanced functionality available in 
computer-implemented books without detriment to the immersive reading experience 
presents a challenge. For example, the prior art provides traditional user interface 
features, such as pull-down or pop-up menus or help balloons through which users 
may access additional functionality while viewing an electronic document. However, 
such traditional user interface features clutter the viewing area and detract from the 
user's immersive reading experience. Accordingly, it would be advantageous to 
provide a user interface which offers a user access to the enhanced functionality that 
can be provided by a computer-implemented book or document, yet which maximizes 
the potential for the user to have an immersive reading experience. 

Summary of the Invention 
The present invention addresses the aforementioned problems by providing an 
apparatus and method for presenting electronic documents to users in the form of 
immersive reading pages. Immersive reading pages mimic the presentation that is 
provided by printed paper documents. There are no traditional user interface features 
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displayed to the user, yet the user has access to the enhanced functionality that can be 
provided by computer-implemented documents. For example, the user has access to 
intrabook (or inside-the-book) navigational features, such as paging forward and 
paging backward. The user also has access to interbook (or outside-the-book) 
navigational features, such as links to other documents, including help documents and 
library documents, which are listings of other documents. The user also has access to 
content interactive features, such as highlighting, annotating, drawing or looking up 
definitions or synonyms of words in the document. According to the invention, this 
enhanced functionality - functionality that is beyond what is found in a printed paper 
document - is accessible to the user without detracting from the immersive reading 
experience. 

To accomplish this, the invention provides a method and apparatus for 
displaying electronic documents in which enhanced functionality is transparently 
associated with elements displayed on the immersive reading page. For example, an 
immersive reading page of a book displayed on the computer display will have 
elements, such as a page number, title line and content — the actual text of the story 
read by the user as he or she reads the book. These are elements that would appear in 
a traditional paper book page. The enhanced functionality provided by the computer 
is associated with these elements in a transparent fashion, such that a user may access 
the functionality by tapping on interaction zones associated with particular elements 
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but no visual indicators or controls are displayed on the immersive reading page. 
Since the enhanced functionality is transparently associated with immersive reading 
page elements, the enhanced functionality is made available to the user without the 
addition of traditional user interface features and the book is presented in a manner 
that encourages an immersive reading experience. Thus, the enhanced functionality 
may be accessed by the user using a selection device, for example, tapping on a touch 
sensitive screen in an interaction zone corresponding to an element of the immersive 
reading page. 

According to yet another aspect of the invention, the association between 
immersive reading page elements and enhanced functionality is provided according to 
coherent user models, in which a particular type of functionality is associated with a 
particular type of element on the immersive reading page. For example, intrabook 
navigational features are transparently associated with the page number displayed on 
the book page, interbook navigational features are transparently associated with the 
title line displayed on the book page and content interaction features are transparently 
associated with the words in the content of the book. Association according to 
coherent user models makes the transparent association intuitive and easier to learn. 

Another aspect of the invention provides a training mode for permitting the 
user to learn the transparent association behind the immersive reading pages. In an 
exemplary reading application embodying the invention, a visual guides mode is 
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provided in which a user may view the immersive reading pages with visual guides as 
to the interaction zones for which enhanced functionality is associated. The visual 
guides aid the user in intuitively recognizing the association between the elements 
displayed on the immersive reading page and the enhanced functionality associated 
with particular elements. After the user has learned the associations, visual guides 
mode may be toggled off and the immersive reading pages are displayed without any 
visual guides. 



The present invention is illustrated by way of example in the accompanying 
Figures, which should not be construed as limiting, in which: 

FIGURE 1 is a schematic block diagram of a general-purpose digital 
computing environment that may be used to implement various aspects of the present 
invention; 

FIGURE 2 illustrates an exemplary hand-held computer system that can be 
used in accordance with various aspects of the invention; 

FIGURE 3 illustrates an exemplary user interface for providing user access to 
a library of books or electronic documents; 

FIGURE 4 illustrates an exemplary immersive reading page in the form of a 
book title page according to the invention; 



Brief Description of the Drawings 
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FIGURE 5 illustrates an exemplary immersive reading page in the form of a 
book page according to the invention; 

FIGURE 6 illustrates an exemplary immersive reading page showing interbook 
navigation functionality that is associated with a title line displayed on the immersive 
reading page; 

FIGURE 7 illustrates an exemplary immersive reading page showing content 
interaction functionality that is associated with content displayed on the immersive 
reading page; 

FIGURE 8 illustrates an exemplary control document for toggling visual 
guides mode according to the invention; and 

FIGURE 9 illustrates an exemplary immersive reading page having visual 
guides displayed. 



Although not required, the invention will be described in the general context of 
computer-executable instructions, such as program modules, being executed by a 
personal computer. Generally, program modules include routines, programs, objects, 
components, data structures, etc., that perform particular tasks or implement 
particular abstract data types. Moreover, those skilled in the art will appreciate that 
the invention may be practiced with other computer system configurations, including 
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hand-held devices, multiprocessor systems, microprocessor-based or programmable 
consumer electronics, network PCs, minicomputers, mainframe computers, and the 
like. The invention may also be practiced in distributed computing environments 
where tasks are performed by remote processing devices that are linked through a 
communications network. In a distributed computing environment, program modules 
may be located in both local and remote memory storage devices. 

FIGURE 1 is a schematic diagram of a conventional general-purpose digital 
computing environment that can be used to implement various aspects of the 
invention. FIGURE 1 and the following discussion are intended to provide a brief, 
general description of a suitable computing environment in which the invention may 
be implemented. 

With reference to FIGURE 1, an exemplary system for implementing the 
invention includes a general purpose computing device in the form of a conventional 
personal computer 100, having a processing unit 110, a system memory 120, and a 
system bus 130 that couples various system components including the system memory 
to the processing unit 110. The system bus 130 may be any of several types of bus 
structures including a memory bus or memory controller, a peripheral bus, and a local 
bus using any of a variety of bus architectures. The system memory includes read 
only memory (ROM) 140 and random access memory (RAM) 150. A basic 
input/output system 160 (BIOS), containing the basic routines that helps to transfer 
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information between elements within the personal computer 100, such as during start- 
up, is stored in ROM 140. 

The personal computer 100 further includes a hard disk drive 170 for reading 
from and writing to a hard disk (not shown). Also included are a magnetic disk drive 
180 for reading from or writing to a removable magnetic disk 180, and an optical disk 
drive 191 for reading from or writing to a removable optical disk 192 such as a CD- 
ROM or other optical media. The hard disk drive 170, magnetic disk drive 180, and 
optical disk drive 191 are connected to the system bus 130 by a hard disk drive 

G 

)f1 interface 192, a magnetic disk drive interface 193, and an optical drive interface 194, 

ijl respectively. The drives and their associated computer-readable media provide 

=23 nonvolatile storage of computer readable instructions, data structures, program 

modules and other data for the personal computer 100. Although the exemplary 
i=y environment described herein employs a hard disk 170, a removable magnetic disk 

ill 190 and a removable optical disk 192, it should be appreciated by those skilled in the 

; J3 art that other types of computer-readable media are contemplated by the invention. 

For example, media which can store data that is accessible by a computer, such as 
magnetic cassettes, flash memory cards, digital versatile disks, Bernoulli cartridges, 
random access memories (RAMs), read only memories (ROM), and the like, may also 
be used in the exemplary operating environment. 
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A number of program modules may be stored on the hard disk, magnetic disk 
190, optical disk 192, ROM 140 or RAM 150, including an operating system 195, 
one or more application programs 196, other program modules 197, and program data 
198. A user may enter commands and information into the personal computer 100 
through input devices such as a keyboard 101 and pointing device 102. Other input 
devices (not shown) may include a microphone, joystick, game pad, satellite dish, 
scanner, or the like. These and other input devices are often connected to the 
processing unit 110 through a serial port interface 106 that is coupled to the system 
bus, but may be connected by other interfaces, such as a parallel port, game port or a 
universal serial bus (USB). A monitor 107 or other type of display device is also 
connected to the system bus 130 via an interface, such as a video adapter 108. In 
addition to the monitor and speakers, personal computers typically include other 
peripheral output devices (not shown), such as printers. 

The personal computer 100 may operate in a networked environment using 
logical connections to one or more remote computers, such as remote computer 109. 
Each remote computer 109 may be another personal computer, a server, a router, a 
network PC, a peer device or other common network node, and typically includes 
many or all of the elements described above relative to the personal computer 100, 
although only a memory storage device 150 has been illustrated in FIGURE 1. The 
logical connections depicted in FIGURE 1 include a local area network (LAN) 112 
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and a wide area network (WAN) 113. Such networking environments are 
commonplace in offices, enterprise-wide computer networks, intranets and the 
Internet. 

When used in a LAN networking environment, the personal computer 100 is 
connected to the local area network 112 through a network interface or adapter 114. 
When used in a WAN networking environment, the personal computer 100 typically 
includes a modem 115 or other means for establishing communications over WAN 
113. The modem 115, which may be internal or external, is connected to the system 
bus 130 via the serial port interface 106. In a networked environment, program 
modules depicted relative to the personal computer 100, or portions thereof, may be 
stored in the remote memory storage device. It will be appreciated that the network 
connections shown are exemplary and other means of establishing a communications 
link between the computers can be used. The existence of any of various well-known 
protocols, such as TCP/IP, Ethernet, FTP, HTTP and the like, is presumed, and the 
system can be operated in a client-server configuration to permit a user to retrieve 
web pages from a web-based server. Any of various conventional web browsers can 
be used to display and manipulate data on web pages. 

FIGURE 2 illustrates a hand-held computer that can be used in accordance 
with various aspects of the invention. Any or all of the features, subsystems and 
functions of the system described with respect to FIGURE 1 can be included in the 
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hand-held computer of FIGURE 2. Computer 200 includes a computer housing 210 
and a display 212, for example a touch-sensitive flat panel Liquid Crystal Display 
(LCD). Using a selection device 214, such as a stylus, a user can select various areas 
of the display 212 in order to access to various electronic documents and enhanced 
functionality according to the invention as will be explained below. 

Those of ordinary skill will understand that selection device 214 may include 
hard or soft buttons built into the hand-held computer 200 for selecting particular 
associated functionality. Moreover, the selection device 214 may include a user's 
own finger used to select appropriate areas on the touch-sensitive display 212. Thus, 
the term "selection device" is intended to have a broad definition and encompasses 
many variations on well-known input devices. 

FIGURE 3 illustrates an exemplary user interface for providing user access to 
a library of books or other electronic documents. A library page 308 is displayed on 
display 212. A series of titles 310 is presented to the user and includes titles of classic 
novels, for example, as well as titles of other useful documents such as a dictionary. 
When a user taps on a particular one of the titles 310, the title page of the selected 
title is displayed to the user, as shown for example in FIGURE 4. 

FIGURE 4 illustrates an exemplary the title page 410 for one of the book titles 
listed on library page 308. A LIBRARY button 412 enables a user to navigate back to 
the library page 308 and a RETURN button 414 enables a user to navigate to a 
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previously displayed page. Also displayed on the title page 410 are a number of 
controls or links 416 for navigating within the selected book or to an annotations 
index. For example, the FIRST PAGE link allows a user to navigate to a first page of 
the book and the MOST RECENT PAGE link allows the user to navigate to the most 
recently displayed page of the book from a previous reading session. 

It will be recognized that navigation of the electronic documents preferably 
occurs in a single-window or single page viewing environment that provides a single 
navigational focus. That is, only one page of a document can be displayed on display 
212 at one time. This is consistent with the immersive reading environment that is an 
aspect of the invention. As will become apparent from further reading of this 
disclosure, the present invention is applicable to hand-held devices which permit only 
a single document context to be viewed at any one time, and desktop or other 
computers having multiple-window operating systems which permit multiple windows 
to be viewed wherein a reading application - the application that provides for the 
immersive reading of electronic document - is associated with one of the windows. 

FIGURE 5 illustrates an exemplary immersive reading page 500 in the form of 
a book page according to the invention. A title line 510, page number 512 and 
content 514 are displayed on the book page. Significantly, the immersive reading 
page 500 mimics a printed book page in that the immersive reading page appears 
without traditional user interface features on the page, as it would appear if the 
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elements ~ title line 510, page number 512 and content - were printed in a paper 
book. 

According to one aspect of the invention, the page number 512 is transparently 
associated with enhanced functionality providing page turning capabilities, which may 
be accessed by a user tapping on a page number element on the immersive reading 
page. As used in this specification, the term "element" refers to a word, symbol or 
picture on the display and may also refer to areas associated with or in the immediate 
vicinity of a word, symbol or picture. For example, when a user taps an area 
immediately to the left of the page number 512, a previous page is displayed and when 
a user taps an area immediately to the right of the page number 512, a subsequent 
page is displayed. Thus, the functionality providing page turning capabilities may be 
accessed by simply tapping on or near the page number 512 displayed on the 
immersive reading page. This functionality is transparently associated with the 
immersive reading page number element and traditional user interface features, such 
as a "go to" button for example, are not present to interfere with the user's immersive 
reading experience. 

FIGURE 6 illustrates an exemplary immersive reading page showing 
interbook navigation functionality that is associated with the title line 510 displayed on 
the immersive reading page. When a user taps on the title line 510, an on-object user 
interface 600 is displayed and presents the user with a list of descriptive links which 

-13- 

B&W 3797.8461 1 - MS 73294.1 
INVENTORS: JOHN L. BEEZER; WILLIAM HILL; LEROY B. KEELY;DARRYL E. RUBIN; 

DAVID M. SILVER; SUSAN D. WOOLF; JEAN PIERRE DE VRIES 




may be tapped to access interbook navigational functions. The MICROSOFT 
READER GUIDEBOOK link permits a user to access another document which may 
provide help and settings control to the user. The LIBRARY link permits a user to 
access the library page 308 (FIGURE 3). The RETURN link permits a user to 
navigate to a document previously displayed. The QUICK SETTINGS link permits a 
user to navigate directly to the settings control page of a help and settings control 
document. In addition to the interbook navigational links just described, the on-object 
user interface 600 may include intrabook navigational functionality as well. For 
example, the COVER PAGE link permits navigation to the book title page 410 and 
the ANNOTATIONS INDEX link permits navigation to an annotations index 
associated with the book being displayed. 

FIGURE 7 illustrates an exemplary immersive reading page 500 showing 
content interaction functionality that is associated with content 514 displayed on the 
immersive reading page. According to another aspect of the invention, an on-object 
user interface 700 is displayed when a user taps on a word or element of the 
immersive reading page content 514. The on-object user interface 700 provides 
access to content interaction functionality by presenting to the user a list of commands 
that may be performed on or in relation to the selected element of the content 514, in 
this case the word "treasure." This enhanced functionality is transparently associated 
with the content elements since no visual indication of the association is evident on the 
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immersive reading page 500. The on object user interface 700 permits a user to 
access a ADD BOOKMARK command, which will provide a bookmark indicator in 
relation to the immersive reading page. Similarly, the ADD HIGHLIGHT command 
will highlight the selected element, the ADD NOTE command will permit a user to 
enter a note associated with the selected element and the ADD DRAWING command 
will permit a user to provide a drawing associated with the selected element using a 
drawing feature of the reading application. As will be explained, the bookmarks, 
highlights, notes and drawings may be shown or hidden, depending on user 
configuration of the reading application used to view the book. Configuration occurs 
through a QUICK SETTINGS page of a help and settings control document that will 
be explained relative to FIGURE 8. Thus, the user has control over the extent to 
which the immersive reading page is provided with visual indications of bookmarks, 
highlights, notes and drawings. 

As will be apparent to those of ordinary skill from the foregoing description of 
the enhanced functionality provided by the invention, the immersive reading page is 
without traditional user interface features, yet a user is provided with access to 
enhanced functionality - functionality beyond what is provided by a paper book or 
document. Access to this enhanced functionality is provided by transparent 
association of the functionality with existing elements of the immersive reading page. 
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The user recognizes this association intuitively or through the use of visual guides, as 
will be explained below. 

As will also be apparent to ordinarily skilled artisans by the foregoing 
description, the association between immersive reading page elements and enhanced 
functionality is provided according to coherent user models. That is, a particular 
type or category of functionality is associated with a particular type or category of 
element on the immersive reading page. For example, the intrabook navigational 
feature of page turning is transparently associated with the page number displayed on 
the immersive reading page. Similarly, the interbook navigational features are 
transparently associated with the title line displayed on the book page. Likewise, 
content interaction functionality is transparently associated with respective content 
elements. 

wording to another feature of the invention, an enabling technology is 
provided in the rbHn of a training mode for permitting the user to learn the transparent 
association reflected in th^Nqunersive reading pages of a document. Referring to 
FIGURE 8, from within a help ana s sc^tings control document, a user may access a 
settings control page 800 which contains liiiks configured to alter settings of the 
reading application. Here, a number of links, such asSIK)W BOOKMARKS, SHOW 
TEXT NOTES, SHOW DRAWINGS and SHOW HIGHLlb^TS are presented for 
displaying on the immersive reading pages, a number of indicators cott^sponding to 
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content interaction functions. In addition, a link entitled SHOW VISUAL GUIDES 
may be selected to invoke the training mode according to the invention. When the 
SHOW VISUAL GUIDES link is selected by a user, the immersive reading pages are 
displayed as shown in FIGURE 9 with visual indicators 910, 912 and 914 to indicate, 
usually to a new user, that enhanced functionality is associated with the immersive 
reading page elements Relative to ft\e page number element 512, a visual indicator 912 
is provided to the left of the page number 512 to indicate to the user that intrabook 
navigational functionality of paging back is associated with the area to the left of the 
page number 512. Similarly, a visual indicator 910 is provided to the right of the 
page number 512 to indicate that intrabook navigational functionality of paging 
forward is associated with the area to the right of theWge number 512. Title line 510 
is provided with a visual indicator 914 to indicate\to the user that interbook 
navigational functionality is associated with the title line elements. 

It will be recognized by those of ordinary skill that, although exemplary 
indicators in the form of visual indicators are described with reference to the training 
mode of the invention, other indicators are contemplated by the invention and 
intended to be encompassed by the appended claims. For example, audio indicators 
may be provide in which recorded sounds are played to a user through a sound system 
associated with the computer to teach the associations between immersive reading 
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page elements and the enhanced functionality provided in accordance with the 
invention. 

Although exemplary systems according to the invention have been described 
above, it should be appreciated that a variety of modifications will be readily available 
to persons utilizing the invention. The foregoing description is not intended to be 
limiting, but is merely illustrative of exemplary adaptations of the invention. Other 
products, apparatus and methods which incorporate modifications or changes to that 
which has been described herein are equally included within this application. 
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